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Abstract 


The  inverted  complex  Wishart  distribution  is  studied 
and  its  use  for  the  construction  of  spectral  estimates  is  illus- 
trated. The  density,  some  marginals  of  the  distribution,  and 
the  first-  and  second-order  moments  are  given.  For  a vector- 
valued time  series,  estimation  of  the  spectral  density  at  a col- 
lection of  frequencies  and  estimation  of  the  increments  of  the 
spectral  distritution  function  in  each  of  a set  of  frequency 
bands  are  considered.  A formal  procedure  applies  Bayes  theorem, 
where  the  complex  Wishart  is  used  to  represent  the  distribution 
of  an  average  of  adjacent  periodogram  values.  A conjugate  prior 
distribution  for  each  parameter  vector  is  a product  of  inverted 
complex  Wishart  distributions. 


AMS  1970  subject  classifications:  Primary  62H10;  Secondary  62M15, 

62E15- 
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1.  Introduction 

In  multiple  time  series  analysis  complex  multivariate 
distributions  are  commonly  used  to  describe  estimates  of  frequency 
domain  parameters.  A review  of  complex  multivariate  distributions 
and  their  application  in  time  series  has  recently  been  given  by 
Krishnaiah  [8].  The  complex  Wishart  distribution,  in  particular, 
was  introduced  and  used  by  Goodman  [4,5]  to  approximate  the  dis- 
tribution of  an  estimate  of  the  spectral  density  matrix  for  a 
vector-valued  stationary  Gaussian  process.  In  this  paper  the  in- 
verted complex  Wishart  distribution  is  studied  and  its  use  for  the 
construction  of  spectral  estimates  is  illustrated. 

Methods  of  spectral  estimation  typically  Involve  peri- 
odogram  smoothing.  The  amount  and  type  of  smoothing  one  performs 
depend  to  a considerable  extent  upon  prior  knowledge  of  the  spec- 
tral density  to  be  estimated.  A method  of  incorporating  prior 
information  about  the  shape  and  smoothness  of  a spectral  density 
into  the  formation  of  a spectral  estimate  has  been  given  by 
Shaman  [9]  for  a univariate  time  series.  Two  types  of  finite- 
dimensional  parameters  are  considered,  the  spectral  density  ordi- 
nates at  a specified  collection  of  frequencies  and  the  amount  of 
power  in  each  of  a set  of  frequency  bands.  The  method  is  condi- 
tional upon  the  asymptotic  distribution  of  periodogram  averages. 

A formal  procedure  applies  Bayes  theorem,  with  a conjugate  prior 
distribution  being  a product  of  inverted  gamma  distributions. 

The  mean  of  the  posterior  distribution  involves  simple  linear  ad- 
justments of  the  periodogram  averages,  with  coefficients  depending 
upon  prior  distribution  parameters.  Although  the  method  is  not 
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genuinely  Bayesian,  it  does  permit  one  to  incorporate  prior  in- 
formation  about  the  height  and  shape  of  the  spectral  density  into 
the  construction  of  an  estimate  in  a formal  manner. 

The  spectral  density  estimation  methodology  just  dis- 
cussed is  extended  to  a vector  time  series  model  in  the  present 
paper.  The  asymptotic  distribution  of  a set  of  nonoverlapping 
periodogram  averages  is  a product  of  complex  Wishart  distributions. 
A conjugate  prior  distribution  is  a product  of  inverted  complex 
Wishart  distributions. 

In  Section  2 the  density  of  the  inverted  complex  Wishart 
distribution  will  be  derived,  as  well  as  some  marginals  of  the  dis- 
tribution and  its  first-  and  second-order  moments.  Details  of  the 
proposed  use  of  the  inverted  complex  Wishart  distribution  in  spec- 
tral estimation  are  given  in  Section  J>. 

2.  The  Inverted  Complex  Wishart  Distribution 

Let  X^,***,Xn  be  -independent  rxl  vectors,  each  com- 
plex normal  with  mean  0 and-  covariance  matrix  Z (see  Wooding 
[12]  and  Goodman  [5])-  Then  the  rxr  matrix 

n 

w - l xjxl  - 

J-l 

where  the  asterisk  designates  conjugate  transpose,  has  a complex 
Wishart  distribution  with  n degrees  of  freedom  and  covariance 
matrix  Z,  denoted  Wc(r,n,Z).  The  density  is  (Goodman  [5]) 
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w!n"retr(-Z_1W),  n > r,  W>0, 


(1) 


1 

? r ( n ) 1 2 | n 
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whe  re 

r_(n)  = 7r^r^r'1)  n r(n-j+i) 
r J«  1 

is  the  complex  multivariate  gamma  function. 

We  wish  to  determine  the  density  of  V =W  , an  inverted 
complex  Wishart  variate.  The  volume  element  associated  with  a 
Hermitlan  matrix  0 - (c^  + ic^j)  Is 

Lemma.  Let  X be  an  r x r Hermit ian  nonsingular  matrix.  Then 
the  Jacobian  of  the  transformation  Y = X”  is_  | Y | " 

Proof.  Let  A be  an  r x r complex  nonsingular  matrix.  The 
Jacobian  of  the  transformation  Y=AXA*  is  |AA*|“r,  by  (2.8)  of 
Khatri  [7).  The  desired  result  follows  from  consideration  of 
dY  = dX_1  = -X"1dX  X"1  = -X'1dX(X#)'1. 

According  to  the  lemma  the  density  of  V is 


where 
of  V 
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Y n etr(-V~1Y) 


rr(n) 


n+r 


n > r,  V>  0, 


(2) 


-1  -1 
Y =2  . Denote  the  distribution  of  V by  Wc  (r,n,Y).  ' 

The  marginal  distributions  of  certain  sets  of  elements 

are  also  inverted  complex  Wishart.  Let 


V11  V12 
V21  V22 


1 
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where  V11  is  qxq«  and  partition  y similarly.  Consider  the 
distribution  of  V^.  The  method  of  derivation  is  that  given  by 
Tiao  and  Zellner  [10]  for  marginals  of  the  inverted  Wishart  dis- 
tribution, modified  for  the  present  complex  case.  The  Jacobian 
of  the  transformation  from  V^g,  Vgg  to  G,  H, 


G = V"1  V . H = V - V V"1  V 
U V11  V12  22  V21  11  V12 


is  | V , from  (2.3)  of  Khatri  [7].  Then  the  marginal 

density  of  is  seen  to  be 


,T..ln-r+q  TU) 

n-r+2q 


JL11 
rq(n-r+q) 
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!<q<r<n,  V±±  > 0. 
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That  is,  7^  is  W~  (q,n-r+q, ).  When  q=l,  has  the  in- 

verted gamma  distribution  with  density 


r(n-r+l) 


n>  r,  V1±  > 0. 


Next  we  consider  first-  and  second-order  moments  of  V. 

The  derivation  follows  that  given  by  Kaufman  [6]  for  the  real  in- 
verted Wishart  distribution.  The  method  is  to  write  the  complex 
Wishart  matrix  W as  TT*,  where  T is  lower  triangular.  The 
joint  distribution  of  the  elements  of  T is  easily  obtained  when 
2=1  and  can  be  used  to  derive  moments  of  T in  the  general  case 
If  the  r x r Hermitian  matrix  W is  written  as  TT*, 
where  T is  lower  triangular,  the  transformation  from  W to  T 


- U - 


has  Jacobian 


j-i  jj 

(see  Goodman  [5],  p.l65)*  Then  by  (l)  the  density  of  T is 


- II  t 2n_2^+1  etr(-Z-1TT*) 

■ ‘ ‘ ln 


rr(n)|Z|n  j*l 


(3) 


When  Z = I,  (3)  becomes 


n 

J=1 


2 

r(n-J+l) 


exp(-t 


2 

JJ 


x . 2n-2 j+1 


r 

n 

=2 


i-i 

n 

k=l 


which  is  the  density  of  £r(r+l)  independent  random  variables. 
Specifically,  2t^2  is  X2n-2j+2'  Z=±,"',r,  and  t = t JkR  + it JkI 

has  a univariate  complex  normal  distribution,  j>k.  The  pair 
(t t T)  is  bivariate  normal  with  mean  0 and  covariance 

jKK  jKx 

matrix  *I2* 

-1  * 

The  inverted  complex  Wishart  matrix  V=W  is  S S, 

^ A 

where  S = (s.v ) =T  is  lower  triangular.  To  clarify  some  later 

JK 

discussion  we  denote  W by  Y when  Z =1,  that  is,  when  T 
has  density  (4). 

In  terms  of  elements  of  T, 
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j=l,« • • ,r. 


J-l  J-2  J-l 

kk  ( Jk  \ Jil  Zlk  ^ ^UjXlUielZ2Uz2k 


Z -!_=*+! 


+---+(-l)J  UJ, j-luj-l, j-2  ■**  ^k+l.kj'  J>k' 


Z2=k+1  ^^=/2+l 


(5) 


where 


ujk  ' tjk /Jtiy 


J >k. 


(6) 


When  2=1  the  distribution  of  (2n-2j+2)^u ..  is 

jk 


com- 


plex t with  2n-2j+2  degrees  of  freedom.  The  density  of  this 
complex  t variate  with  f degrees  of  freedom  is 


g(u)  = 


2T(1+lf.) 


2\  ft'+l 


Some  moments  of  the  variables  t^j,  tjk,  and  u^k  when 
2=1  are  required.  First  note 


E(tjj2)  *n=7’  E(tjj4)  - Tn-JKn-J-l)  ’ 


(7) 


J=l,***r,  n>r+l. 


The  complex  normal  variables  tjk  satisfy 


E(|tJkl2)=l>  E(ltjk|4)=2' 


(8) 


and  these  are  the  only  nonzero  moments  up  to  order  four.  That  is. 


p 

all  odd  moments  of  t^  are  0,  and  moreover  E(t^k)  = 0, 

E(tj^)  = E(tjktjk^  For  the  ujk  variables>  (7)  and  (8) 

imply 

E(|ujk|2)  = E(lu,jkl4)  = Tn-'J'jfn-j-lT  ' (9) 

d > k,  n>  r + 1, 

and  these  are  the  only  nonzero  moments  up  to  order  four,  as  with 
the  variables  t..  . 

The  elements  of  Y are 


Jk 


I 


g=max( j,k) 


Bgjsg*  ’ Jik' 


(10) 


By  (4)  - (6)  and  the  discussion  following  (8),  we  see  that 


E(sgJ  Sgk)  = 0,  J }=k.  Therefore 

E(yJk)  - 0 * 


d ^k. 


(11) 


By  (4)  - (10), 


6-1 


E(|ss3|2)  = H^g  + I rTgH^ 

1 x±=d+ i 1 


6-2  g-1 

+ y y 

L L n-g  n-x.  n-x 

_ a i 4 -L 


i2^  d+1  *i®X2+1 
1 1 


\ 


+ . . . + 


n-g  n-g+1  * * * n-j-i 


(12) 
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It  follows  from  (5)  and  (6)  with  t^j=n-J,  j=l,***,r,  t^k=-l, 

2 

J>k,  and  (12)  that  the  rxr  matrix  with  elements  E(  | s j | ) 
is  the  inverse  of 


n-1 

0 

0 

0 

-1 

n-2 

0 ... 

0 

-1 

• 

• 

-1 

• 

• 

n-3 

• 

• 

0 

• 

• 

• 

-1 

• 

-1 

• 

-1  ... 

• 

n-r 

which  is 


n-1  (n-J 


.n-2  n-j 


n-2  n-. 


...  0 
0 
0 


, n-r+1 ) n-r. 


, n-r+1 ) In-: 


. n-r+1 ) (n-r 


Therefore 


■ IE<IS63|S) 

g=j 

r-j-1 

■ n=J  + I In: 

i=0 

1 

n-r  ’ 


n- 1-1-: 


J=l,-  • • , r. 


Evaluation  of  second-order  moments  of  the  elements 
of  Y is  much  more  difficult  and  tedious.  From  the  above 


i ^ 


- 8 - 


discussion  it  follows  that 


I 


Cov^yjk,y/m^  =0  mxless 


or  j=m,k=X. 


(1*0 


Lengthy  direct  calculations  from  (4)  - (ll)  and  (13)  yield 


Var(y , .)  * 

^ (n-r)2(n-r-l) 


, j=l,  • • * ,r,  n>r  + l. 


(15) 


Cov(y,,,y.  , ) = 


**  ~ (n-r+1) (n-r)2(n-r-l) 


, J fk,  n>  r + 1,  (16) 


and 


Cov(y,.  ,y.  .)  = 


jk,ykj ' ~ (n-r+1) (n-rj (n-r-lj 


•,  j f k,  n > r + 1.  (17) 


Now  let  Z be  an  arbitrary  Hermitian  positive  definite 
matrix.  Write  Z = AA*,  where  A is  lower  triangular.  If  W is 


Wc(r,n,I),  then  AWA*  is  Wc(r,n,Z).  The  desired  inverse  is 


V = B*YB,  where  B=A_1  and  Y is  Wl1(r,n,l).  Thus 


r r 

vJk  I I^ajya0b@k'  J,k=l,-*-,r. 
a=j  0=k 


(18) 


From  (11),  (13)  - (18),  and  some  further  manipulations  we  obtain 
the  desired  moments  of  V,  denoting  Z-1  = (a^lc), 


E(V) 


n > r. 


(19) 


a Jm0 zk  + _1_  aJka/m 


Cov(VJk' Vjtm)  = (n-r+i)  (n-r)  (n-r-1 ) ' n>r  + l.  (20) 
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J>.  Application  of  the  Inverted  Complex  Wishart  Distribution 
to  Spectral  Estimation 


The  methodology  described  below  is  based  upon  distribu- 
tional approximations  and  we  make  assumptions  which  allow  these 
to  hold.  The  conditions  in  Brillinger,  [l]  and  [2],  Chapters  5 
and  J,  in  particular,  are  used. 

Let  X(t)  (t=0,  +1,***)  be  a vector-valued  strictly 
stationary  stochastic  process  for  which  all  moments  exist.  Denote 
the  components  of  X(t)  by  X^(t)  ( j =1, • • • ,r) , the  mean  by 
E{X(t)}=m,  and  the  spectral  density  by  f ( X ) (“ir<X<70-  The 
cumulant  functions  of  the  process  are 


(^=1,*  • • , r,  i=l,  • • • ,k,  t±+t,  • • • , tk_1+t,  t=0,  + 1,  • • • ,k=2,3,  • • • ). 
Assume  for  j^=l, • • • ,r(i=l, • • • ,k)  that 


00 


(k=2,3i ' * * ) • 


(21) 


This  ensures  the  existence  and  uniform  continuity  of  cumulant 
spectra  of  all  orders. 

Assume  a time  series  X(t)  (t=0,l, * * • ,T-l)  is  avail- 
able. The  periodograra  is 

I(X)  =-5^  2(x)z(x)*  (-7r<X<7r),  (22) 


10 


where  Z(\)  eixtX(t)  ( -7r < X < tt).  Let  p = {£(T-l)].  Then 

I(2ttJ/T)  are  asymptotically  independent  variables  distributed 
as  Wc(r,l,f  (27rj/T) } (j-1,  • " ,p)  (see  Brillinger  [2],  Theorem 
7.2.4).  Also  I(t r)  is  asymptotically  an  rxr  Wishart  variable 
with  one  degree  of  freedom  and  covariance  matrix  f(7r),  and  is 
independent  of  the  other  variables.  If  m |=0,  1(0)  is  approxi- 

mately an  rxr  noncentral  Wishart  variable  with  one  degree  of 
freedom. 

Restrict  attention  to  frequencies  0 < \ < v and  let  j(T) 
be  a sequence  of  integers  such  that  2ttJ(T)/T  is  near  \(js0,7r) 
and  converges  to  \ as  T-*®.  Then 

n 

2 *2^1  7 I[27r(j(T)+h}/T]  (23) 

h=-n 

is  an  estimate  of  f(\)  and  is  asymptotically  distributed  as 
(2n+l)_1Wc(r,2n+l, f (\) }.  If  x=0  (23)  is  replaced  by 

n 

2 = n I I(2irh/T),  (24) 

h=l 

and  if  \ = v, 

n 

z » £ I(7r-2Trh/T)  (T  even) 

h=l 

(25) 

n 

* H I I(7r-Tr/’r-2TrhA)  (T  odd) 

. h-1 
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is  used.  The  complex  Wishart  was  established  as  a limiting  distri- 
bution for  (22)  and  for  (23)  - (25)  with  fixed  n by  Brillinger  [1] 
for  the  case  m=0.  For  x4=0,  the  asymptotic  distributions  of 
I(X)  and  z are  the  same  whether  or  not  m=0  and  in  [2] 
Brillinger  treats  an  arbitrary  m.  Wahba  [11]  and  Gleser  and 
Pagano  [3]  allow  n ■*  ® under  the  assumption  X(t)  is  Gaussian. 
Under  appropriate  conditions,  M nonoverlapping  sums  of  the  form 
(23)  are  asymptotically  independent  complex  Wishart  matrices  as 
n,  M,  T -► ».  The  covariance  matrices  of  the  asymptotic  complex 
Wishart  distributions  are 

n 

SZtf;  X f[27r{,3(T)+h}/T], 
h=-n 

where  2ttJ(T)/T  converges  to  some  x as  T -*■<*>. 

Consider  estimation  of  the  spectral  density  at  a fixed, 
preassigned  set  of  frequencies,  0 < X1  < • • • < XM  < ^ The  choice  of 
M and  the  frequencies  may  involve  use  of  prior  information.  For 
example,  if  the  spectral  density  is  considered  a priori  to  be 
approximately  constant  in  certain  bands,  the  frequencies  may  be 
interior  points  of  the  bands. 

To  avoid  anomalous  cases  assume  > 0,  Let 

z-w  denote  the  right-hand  side  of  (23)  for  2n+l  > r and 

J ft  " 

2vj(T)/T  near  \ (X-1,»**,M).  Define  z = (z^,  • • • , z^)  and 
f * [f(x1) , ’ * * >f (xM) }•  We  use  the  asymptotic  distribution  of  z 
described  above.  Then  z has  density 


(2n+l)(2n+l)rM  -S  >ZJ 

— — — jt—  TT  — ■ pn+1  etr{-f (x  ) 1(2n+l)z  J 

£rr(2n+l)}M  1=1  |f(X'J|2n+1  L 1 r 

r x (26) 


h(z| f ) 


(2n+l > r). 


Then  a conjugate  prior  density  is  a product  of  inverted  complex 
Wisharts , 


h(f) 


IT  lg/1  1 etr{-f(xi)“1gi3 


1*1 


r (o^lrtx^l  4 


a.+r 


(ax>r,  1*  M) 


(27) 


The  posterior  density  from  (26)  and  (27)  is 


h(f|z) 


j l(2n-fl)z t*9t\ 


2n-t-l+a 


1 etr[-f(x/)_1{(2n+l)zx+0x}] 


1=1 


rr(2n+ltax) |f(xx)  I 


2n+r+l+a, 


(28) 


a product  of  inverted  complex  Wishart  densities.  The  mean  of  the 
posterior  occurs  at  f (x^)  = { (2n+l)zx  + gx}/(2n+l+ax~r)  (l=l,***,M). 

Knowledge  of  the  spectral  density  ordinate  at  each  of  a 
number  of  specified  frequencies  can  convey  an  accurate  picture  of 
the  shape  of  the  curve.  However,  moi'e  basic  interest  may  concern 
the  increments  of  the  spectral  distribution  function  in  certain 
frequency  bands.  Consider  a partition  0 = xQ  < X^  < • • • < XM  < XM+1  = * 
and  let  F(x)  denote  the  spectral  distribution  function.  Consider 
the  parameter  p • (p^  • • • »PM+1)  > where  P*  = F(xx ) - F(x/_1 ) 

(l=l, • • • ,M+l) . The  partition  is  fixed  for  all  sample  sizes.  Let 
kx(T)(l=0,* • • ,M+1,  kQ(T)=l,  kra+1(T)  = [^(T-l) J } be  integers  such 
that  the  frequencies  2ttJ/T  are  in  the  interval  ^ for 
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k^_i(T)  < j < k^  (T)-l  and  define  m^(T)  = k^(T)-  k ^(T).  Then 
under  the  assumption  (21)  and  the  conditions  in  Wahba  [11]  or 
Gleser  and  Pagano  [J>]  the  sums 

k,(T)-l  ‘ 

7 = V I(2ttJ/T)  U=1,...,M+1) 

are  approximately  distributed  as  independent  r x r complex  Wishart 
variables  with  m^(T)  degrees  of  freedom  and  covariance  matrices 

X ^(T)-! 

^ ^ ( 2 v J/T ) ( l =1 1 « • • > M+l ) . 

We  further  approximate  the  distribution  of  y as  that  of 
Wc{r,m^(T),  Tp^/(27rm^  (T) ) } (x=l, . . . ,M+1) . Details  of  the  transition 
to  a posterior  distribution  for  the  parameter  p are  similar  to 
those  given  at  (26)  - (28).  One  can  restrict  attention  to  a set  of 
frequency  bands  whose  union  forms  a subset  of 
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